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We find the asymptotic distribution of the sample autocovariances of long-memory processes 
in cases of finite and infinite fourth moment. Depending on the interplay of assumptions on 
moments and the intensity of dependence, there are three types of convergence rates and limit 
distributions. In particular, a normal approximation with the standard rate does not always 
hold in practically relevant cases. 
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1. Introduction 

Over the last twenty years, long-memory time series have become an important modeling 
tool in geophysical sciences and also in engineering, computer networks and econometrics. 

Asymptotics for the sample autocovariances of long-range dependent linear processes 
with tail index a are known only in the case 1 < a < 2; see Kokoszka and Taqqu (1996). In 
the case 2 < a < 4, these asymptotics are known only for linear processes with absolutely 
summable coefficients ^(j); see Davis and Resnick (1986). To illustrate what kind of 
results we are interested in, consider the sample variance 70 = iV _1 J2t=i -^t ■ Theorem 
2.2 of Davis and Resnick (1986) implies that 



A^(7o-7o)A^^(j)lS-— -I, (1.1) 

where ajv is roughly of the order N 1 ^ and S is an (a/2)-stable random variable. Note 
that the right-hand side of (1.1) involves only the sum of the squared coefficients ip(j), 
yet this result is known to hold only if 5Zj=o < 00 • The question is whether (1.1) 

holds if one assumes only ^ ip 2 (j >) < 00 (and zero mean) and, if not, what the limit 
of NaJ^^jo — 70) is in this more general case. 



This is an electronic reprint of the original article published by the ISI/BS in Bernoulli, 
2008, Vol. 14, No. 2, 405-418. This reprint differs from the original in pagination and 
typographic detail. 
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Figure 1. Regions with different rates of convergence of sample autocovariances. 



We assume that the ip(j) behave roughly like with < d < 1/2. Figure 1 sum- 
marizes the convergence rates derived in our paper. The a-axis shows the tail index of 
the innovations, but a > 4 is used merely for illustration; our results require only finite 
fourth moment in that case. The currently known asymptotics correspond to the cases 
with d = 0, except the case when all moments are finite (considered by Hosking (1996)). 
Our results for the region 4 < a < oo extend the corresponding results of Hosking (1996). 
In region A. 70 — 70 is of the standard order TV -1 ' 2 ; in region B, it is roughly of the or- 
der TV 2 /"" 1 . These two regions show how far the rates established for weakly dependent 
processes extend. In region C, the asymptotic distribution of jh — 7^ does not depend 
on h and the limit is related to the Rosenblatt process. 

The paper is organized as follows. Section 2 introduces the assumptions and the req- 
uisite notation. Main results arc stated in Section 3. Section 4 contains an important 
truncation lemma which allows us to assume only the second moment and two lemmas 
which can be deduced from the work of Surgailis (1982). The proofs of the main results 
are developed in Section 5. 

2. Assumptions and notation 

We consider the linear process 



00 




(2.1) 



3=0 
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Throughout the paper, we denote by Z a random variable with the distribution of the 

z t . 

We assume that the Z t are mean zero i.i.d. and satisfy either EZ 4 < oo or for some 
2 < a < 4, <p<l and a slowly varying function L(x), 

P[\Z t \>x]=x- a L{x), P[Z t >x]/P[\Z t \>x]->p (a; ->«>). (2.2) 

In both cases, the second moment is finite and we write 

cr 2 = Var[Z] =EZ 2 . 

We assume 

oo 

]Tv 2 (j)<cx). (2.3) 

3=0 

Assumption (2.3) is a sufficient condition for the L 2 and a.s. convergence of the right- 
hand side of (2.1) if EZ t 2 < oo. (Note that we assume EZ = 0.) Condition (2.3) is weaker 
than the condition X)j=o < 00 an< ^ a ll°ws us to consider linear processes with long 

memory. 

We focus on the case ip(j) ~ Cdj d ~ 1 and assume 

m=j d ~ 1 Kj), 0<d<l/2, (2.4) 

where /(■) is a function defined for positive real numbers such that l(u) — > Cd as in 
oo. All long memory models in current use, including the fractional ARIMA and the 
fractional exponential model, satisfy (2.4). 

Suppose we observe a realization X 1: X 2 , ■ ■ . , X^+h, N > 1,H > 0. The sample auto- 
covariances are defined as 

1 N 

%=Kz2 XtXt + h > h = 0,l,...,H, 
t=i 

and the (population) autocovariances are 

oo 

lh = nw h ] = <j 2 Y, i>U)i>{j + h). 

3=0 

When working with the innovations satisfying (2.2), we use the norming constants cin 
satisfying 

lim NP[\Z\>a N x]=x- a , x>0. (2.5) 

N^oo 

It is well known (CLT for i.i.d. r.v.'s in the stable domain of attraction) that there is an 
(a/2)-stable random variable S such that 

N 

a]?J2(Zf-b N )±S, (2.6) 
t=i 
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where b N = E[Z 2 I{\Z\ < a N }]. 

Finally, recall the definition of the Rosenblatt process: 



U d (t) = 2 



xi<x 2 <t 



(v-x 1 ) d + - 1 (v-x 2 ) a + - L dv 



d-1 



W(dxi)W(dx 2 ), 



(2.7) 



where W(-) is the standard Wiener process on the real line. 



3. Main results 



We want to find the asymptotic distribution of the vector 

[%- jh,h = 0,1,..., H}. 
We first focus on the case of heavy-tailed innovations satisfying (2.2). 

Theorem 3.1. Suppose (2.2) and (2.4) hold. 
(a) If < d < I /a, 2 < a < 4, then 

Na^ 2 [%-j h ,h = 0,1,..., H] 



'N 

,1 



s- 



a-2 



J2i>U)i>U + h),h = 0,1,..., H 

3=0 



(For the above to hold for d=l/4, we must additionally assume that 
(b) Ifl/a<d< l/2,2<a<4, then 

N 1 -™^ -i h ,h = 0,l,...,H]S a 2 Cj[U d (l), h = 0,l,...,H\. 

Proof. A detailed proof with the requisite notation is presented in Section 5. Part (a) 
follows from Lemmas 5.1 and 5.2, while (b) follows from Lemmas 5.3 and 5.5. □ 

If 1 < a < 2, then Theorem 2.1 of Kokoszka and Taqqu (1996) implies that Na^^h 
converges in distribution, so the autocovariances themselves are not bounded in proba- 
bility. 

We now turn to the case EZ 4 < oo. If the ip(j) are absolutely summable, then we have 
the following well-known result; see Proposition 7.3.3 of Brockwcll and Davis (1991). 

Theorem 3.2. Suppose J^JLo IV'O')! < 00 an d EZ 4 = ?/cr 4 < oo. Then 

N 1/2 [% - 7fc , h= 0, 1, . . . , H] S [G h , h=0,l,...,H], 
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where [G/ l7 h = 0, 1, . . . , H] is a mean zero Gaussian vector with 

oo 

~E[G h G h '] = (17 - 3)7h7fc/ + ^ [7fc7fc-fc+/i' + 7fc+fc'7fc-h]- ( 3 -l) 

k— — oo 

Condition (2.4) implies that the V'O') are n °t absolutely summable. In this case, the 
following theorem holds. 

Theorem 3.3. Suppose EZ 4 = r/c 4 < 00 and (2.4) holds. 

(a) If0<d<l/4, then 

N 1 / 2 [%- lh ,h = 0,l,...,H)S[G h ,h = 0,l,...,H), 

where [Gh, h = 0, 1, . . . , H] is a mean zero Gaussian vector with covariances (3.1). 

(b) If 1/4 <d< 1/2, then 

N 1 - 2d [%-j h ,h = 0,l,...,H]^a 2 Cj[U d (l),h = 0,l,...,H]. 
Proof. Use Proposition 5.1 for (a) and Lemmas 5.3 and 5.5 for (b). □ 

4. Auxiliary lemmas 

We begin with a truncation lemma which allows us to extend the results established under 
the assumption of all finite moments to our setting in which only the second moment is 
assumed finite. 

Lemma 4.1. Suppose Z is a random variable with EZ = and EZ 2 < 00. There are then 
bounded random variables Z(T),T > 0, such that ~EZ(T) = and, as T — > 00, E[Z(T) — 
Z}' 2 -> and VZ 2 (T) -> EZ 2 . 

Proof. Let fx(T) = E[ZI{\Z\ < T}]. If /i(T) = 0, set Z{T) = ZI{\Z\ < T}. If fi(T) ^ 0, 
then let s(T) be a random variable uniform on [0, |/i(T)|] and independent of Z, and set 

Z(T) = Z1{\Z\ <T}- 2e(T) sign(/i(T)). 

Then EZ(T) = 0, by the definition of Z(T). Moreover, 

E[Z(T)-Z] 2 =E[Z1{\Z\ >T}-2e(T)sign(^(T))] 2 
< 2[E(Z 2 I{|Z| > T}) + 4Ee 2 (T)]. 

Since EZ 2 < 00, E(Z 2 I{|Z| > T}) -> 0, and Ee 2 (T) = pt 3 (r)/3 -> because /Lt(T) -> 
EZ = 0. The assertion EZ 2 (T) -> EZ 2 now also follows. □ 
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The following lemma is a special case of Lemma 7 of Surgailis (1982). 
Denote by {W(£)} the standard Wiener process on the real line. Consider the sequence 
{Wn, N > 0} of random sequences 

W N = {W N (k),k = ...,-1, 0,1,...}. 

It is convenient to think of Wpj(k) as approximately the increment of W over the interval 
[k/N,(k+l)/N). 



Lemma 4.2. Suppose each W;v(fc) has all finite moments, EWjv(k) = and Var[W0v(fc)] 
N" 1 . Assume that for any real numbers a <b, 



W N (k)Sw(b)-W(a). 

aN<k<bN 

Let f(x\,X2) be a measurable function such that 

/OO />OC 
/ 1/(^1, £2)| 2 d.Tidx2 < 00. 
-oo J — oo 

Suppose {/at, iV > 1} is a sequence of measurable functions of the form 

f N (xi,x 2 ) = ^ c N(k,k')I[ k / N ^ k+1 y N - ) (x 1 )I[ k ,/ N ^ k , +1 y N - ) (x 2 ) (4.1) 
k^k' 

such that 

oo /.oo 

|/(xi,x 2 ) - /at(xi, x 2 )| 2 dxi dx 2 —*Q asN^oo. (4.2) 



oo J — oo 



Then, as N — > oo, 

/oo /.oo 
/ /(xi,x 2 )W(dxi)W(dx 2 ). 

The next result is similar to Lemma 4 of Surgailis (1982). The extension involves the 
presence of the lag h. To state it, we introduce the coefficients 

N 

C N , h (k, k') = N x - 2d Y i/>(t - k)if>(t + h- k') (4.3) 
t=i 

and set 

fN,h{x\,X%)= 2J CA r ^( fc I fc ') I [fc/JV,(fc+l)/Ar)(xi)I[fc'/Ar,(fc' + l)/Ar)(x 2 ). (4.4) 
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Lemma 4.3. Consider the function f defined by (5.12) and the sequence of functions 
fa defined by (4-4) an d (4-3)- Suppose (2.4) holds. If d> 1/4, then 



oo />oo 



[fN,h(xi,x 2 ) ~ /(a;i,a;2)] 2 dxida;2 -> as N — > oo. (4.5) 



oo «/ — OO 



Proof. By Lemma 4 of Surgailis (1982), (4.5) holds with h = 0. Thus, it is enough to 
show that 



oo poo 

2. 



[fN,h(xi,X2) - fN,o(xi,x 2 )} dx 1 dx 2 ^0 msN^co. (4.6) 

00 j —00 

Relation (4.6) can be verified using the dominated convergence theorem. □ 

5. Proofs 

We begin with the proof of part (a) of Theorem 3.3 as it is uses an approach which differs 
from that of the remaining proofs. The idea is the same as in the proof of Proposition 
7.3.3 of Brockwcll and Davis (1991), but the summability arguments must be handled 
with care. 



Proposition 5.1. The conclusions of Theorem 3.2 remain true if the assumption 

J 3= 



J27Lo 1^0)1 < 00 * s replaced by (2.4) with the restriction < d < 1/4. 



Proof. For sufficiently large m, define 

m N 

X[ m) =5>(j)Z t _,, 7W =N~iJ2 X t m)x t?l 

3=0 t=l 

and 

rn—h 



3=0 

Proposition 7.3.2 of Brockwcll and Davis (1991) states that, as N — > oo, 

N 1 ' 2 ili m) - lt n) , h = 0, 1, • • . , H] 4 [G^ ,h = 0,l,...,H], (5.1) 
where [G, , h = 0, 1, . . . , if] is a mean zero Gaussian vector with 

oo 
k— — oo 
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The proof is completed by appealing to the standard argument; see Theorem 3.2 on page 
28 of Billingslcy (1999), which, in addition to (5.1), requires 

[G i ™ ) ,h = 0,l,...,H]-i>[G h ,h = 0,l,...,H], as m -> oo (5.2) 
and, for each h and e > 0, 

lim hmsupPfJiV 1 / 2 ^ - 7 £ m) ) - N l ' 2 {% - lh )\ > e} = 0. (5.3) 

Relation (5.2) follows from the convergence 7^ — > 7/i for which only the square 
summability of the is needed. 

To prove (5.3), it suffices to show that lim m _>oo limjv-too N Var[7^ —jh] =0, which 
reduces to verifying that 

EG 2 , (5.4) 

EG 2 , (5.5) 

EG 2 . (5.6) 

To establish (5.4)-(5.6), we need the assumption d < 1/4. As in the proof of Proposition 
7.3.1 of Brockwell and Davis (1991), we have 

NV&r[%] 

(rj - 3)<t 4 ^2 i>(i)tp(i + h)ip(i + k)ip(i + k + h)+ j k ~/ k + jk+hlk-h 

i 

Relation (5.4) now follows from the dominated convergence theorem, for which we need 
^2^2 \ip{i)ip{i + h)Tp(i + k)i(j(i + k + h)\ < oo (5.7) 

k i 

and 

A.- 

While the square summability of the is sufficient for (5.7) to hold, for (5.8), we need 
Sfc>o k 4d ~ 2 < oo, which requires that d < 1/4. 

The same argument and the convergence lrnim^oo EG[ m ' 2 = EG 2 lead to (5.5). Rela- 
tion (5.6) follows in a similar manner. □ 

In the following, we work separately with diagonal and off-diagonal terms. 



lim A^Var[%] = 
lim lim iWarP^l = 
lim lim NCov(j ( ™\%) = 



k <N v 7 
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Fix real numbers Uh, h = 0, 1, . . . , H, and consider the decomposition 

H 



^ Uh{% - lh) = D N + R N , 



h=0 

with the diagonal terms 

H , N oo 



d n = ^T u h d N ,h, d N . h = — ^2 ^2 ip(j)ip(j + h) [Zt_j - a 2 } , 



N ■ 

h=0 t=l 3=0 

and the off-diagonal terms 

H , N 



N 

h=0 t=l ijtj+h 



H 



Rn =^>2uhrN,h, TN,h = itf ^ ^ ^{j)^{i)Zt-jZ t+ h-i- 

Also, define 

c j = zJ UhC J^ 1 )' C J'W = ^(3)^(3 + h). (5.9) 

fr,=0 

Note that c 3 (h) ~ C 2 j 2d ~ 2 , so the Cj arc absolutely summablc. 

The next two lemmas are specific to the case of infinite fourth moment and so are 
established first. 

Lemma 5.1. Suppose 2 < a < 4 and that (2.2) and (2.4) hold. Then 
Na N 2 [d N , h ,h = 0,l,...,H} 



S 



a - 2 



J2^(j)^(j + h),h = 0,1,..., H 
i=o 



Proof. Observe that D N = N' 1 J2t=i E^o c J^t-j ~ ^ E^o 

Cj. Since the Cj defined 

by (5.9) are absolutely summable, using Theorem 4.1 of Davis and Resnick (1985) and 
following the proof of Theorem 2.2 of Davis and Resnick (1986), we conclude that 

Na N 2 D N S(S-^)j:T=o^- □ 

Lemma 5.2. Suppose 2 < a < 4 and that (2.2) and (2.4) hold. If d < 1/a (and 
a N 4 N\nN^0 if d=l/A), then Na^ 2 r NJl ^0. 

Proof. Set £ t (h) = EijZp&j+hWWWZt-iZt+h-i 80 that = N ~* E£i &(>»)■ H 
EZ = and EZ 2 = cr 2 < 00, then for < d < 1/2, 

E[£n£o]=o- 4 [^(^(Mii-n^ij -n) + ifj(i)iP(j)ij(j -n)i;(i~n)}, 
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which implies E[£„£ ] ~ Kda 4 n 4d 2 . Therefore, 

" N 



Var 



,t=i 



(O(N), if < d < 1/4, 

I 0(N\nN), ifd=l/4, (5.10) 
[o(N 4d ), ifl/4<d<l/2. 



The claim follows because = N 1 ^ a L(N), where L(-) is slowly varying. □ 

The following lemma establishes asymptotics for the diagonal terms in the case of finite 
fourth moment. 

Denote by N(0, X) an (H + l)-variate normal vector with the covariance matrix S = 
{S(h, ti), h, ti = 0, 1, . . . , H} given by 

oc oo 

E(fc, ti) = Ee 2 J2 E <* W c k( ft ')> (5-11) 

i=0 fe=0 

in which the Cj(ti) are defined by (5.9). 

Lemma 5.3. Suppose that EZ 4 < oo and (2.4) holds. Then 

N^ 2 [d N , h ,h = 0,l,...,H]^N(0,'E). 
Proof. Use Theorem 7.7.8 of Anderson (1971). □ 

In the remainder of this section, we study the off-diagonal terms in the case d > 1/4. 

Assuming only EZ 2 < oo, using Lemma 4.1, we can define a sequence of bounded, inde- 
pendent, identically distributed random variables Zi(T) such that EZj(T) = 0, E[Zj(T) — 
Zi] -> and Z ? (T) is independent of {Zj(T),j ^ i}. Further, define 

H 

R N (T) = ^u h rN,h(T), 

h=0 

where 

N 



"( r ) = ^E E mmzt-AT)z t+h -m 

t=l i^j+h 
1 N 

= nH z * ^ Zk ' en E>(* - *w* + - k ') 



k^k' t=l 

Denote by {W(i)} the standard Wiener process on the real line. 
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Lemma 5.4. Suppose EZ 2 < oo and (2.4) holds. If d> 1/4, then 
N 1 - 2d [r N , h (T),h = 0,l,...,H] 

r poo poo 

^<J 2 {T) / / f(xi,x 2 )W(dx 1 )W(dx 2 ),h = 0,1, 
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oo «/ — OO 



where a 2 (T) = Var[Z (T)] and 



f( Xl ,x 2 ) = Ci / («-x 1 )5T 1 (t;-a:2)+ d« 



(5.12) 



Proof. Introducing 



H N 



C N (k, k') =J2 Uh J2 N^'^iit - k)tjj(t + h- *'), 

we obtain 

R N (T) = N 2d - 2 C N {k,k')Z k {T)Z k ,{T)=N 2d - l cr 2 {T) £ C N (k,k')Z* k (T)Z* k ,(T), 

k^k' k^k' 

where Z* k (T) = N^ 1 / 2 Z k (T) / a(T). 

Clearly, EZ^(T) = 0, Var[Z£(T)] = 1/N, and by the functional central limit theorem, 

EaN<k< bN Z k(T) ± W(b) - W(a). By Lemma 4.3, 

p oo p OO 

[fN(xi,x 2 ) - f(x 1 ,x 2 )) 2 -* 0, 



oo J — oo 



where 



/at(xi,X 2 ) = C , Ar(fc,fc')I[ fc / A r i ( fc+1 )/ W )(xi)I[ fe / j / A r i ( fe / + 1 )/ A r)(x2) 



and f(x 1 ,x 2 ) = f(x 1 ,x 2 )J2h=o u h- 

Thus, all conditions of Lemma 4.2 arc satisfied and the claim follows. 



□ 



The next result shows that Lemma 5.4 remains valid without assuming bounded errors. 
Lemma 5.5. Suppose EZ 2 < oo and (2.4) holds. If d> 1/4 (and d< 1/2), then 

r poo />oo 

N 1 - 2d [r N j l ,h = 0,l,...,H}^o- 2 / / f{x 1 ,x 2 )W(dx 1 )W{dx 2 ) > h = 0,l,...,H , 

.J — oo J — oo 



where f{x\ 1 X2) is defined in (5.12). 
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Proof. Since tr 2 (T) — > a 2 , it is enough to show that for any e > and each h = 0, 1, . . . , H, 



Let 



and 



lim HmsupP{JV 1 -^|rjv.h - r N ,h(T)\ > e} = 0. 



&,fcCO = X - + h ~ k')Z k (T)Z k , (T). 

Relation (5.13) will follow once we have shown that 



E 



JV 



1 2 



Observe that 



where 



N 



= E[Z - Z{T)} 2 0{N Ad ) 



<2[S 1 {N,T) + S 2 (N,T)}, 



Si(N,T) 



S 2 (N,T) = 



N 



-i 2 



k)Ht + ft - k')Z k (Z k , - Z k , (T)) 

Lt=l fe#fe' 



AT 



fc)^(t + ft M!)Z w {F){Z k - Z k {T)) 

Lt=i fe#fc' 



(5.13) 



(5.14) 



To compute the expected value 

iV 

E5i {N,T)= X X X^(* ~ + ^ ~ fc 'M s ~ + ft ~ 

t,s=l fe^fe' i^i' 

x E[Z fc (Z fe , - Zv<F))Zi{Z v - Z V {T))\, 

note that the expected value on the right-hand side vanishes, except in two cases: (a) 
k = i and k' = i'; (b) k = i' and k' = i. 
In case (a), 



E[Zk{Z k ' - Z w {F))Zi(Z v - Z V {T))\ = <t 2 E[Z - Z{T)f 
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In case (b), by Schwarz's inequality, 

E[Z k {Z k > - Z k '(T))Z t (Z t i — Zi>(T))] < <t 2 E[Z - Z(T)] 2 . 

It follows that 

ES!(N,T) < a 2 -E[Z - Z(T)] 2 [E n (N, h) + E 12 (N, h)}, 

where 

N 

E n (N, h)=Y^ k ^ + h ~ k 'M s ~ k ^ s + h ~ fc ')' 

s,t=l k=£k' 
N 

s,t=l k=£k' 

We must thus verify that En(N,h) and E\ 2 (N,h) are 0(N 4d ). We will show the verifi- 
cation for Ei 2 (N, h) because the argument for En(N, h) is the same (in fact, it is slightly 
shorter, as the h cancels in the corresponding sums). Setting i = t — k and i' = t + h — k', 
we obtain 

N 

\E 12 (N,h)\ < J2 ^^Hs-t + h + i^^^ii'^is-t-h + i 1 )]. 

s,t—l i i' 

We apply to the right-hand side the method of summing over the diagonals and consider 
the cases ,s — t = 0, n = s — t > and — n = s — t < 0. Consequently, 



\E 12 (N, h)\ < Ex 2 o + Ei2+ + E\ 2 -, 



where 



-I 2 



Efao = N^Mi)1>(h + i)\^\il)(i')il>(-h + i')\<N 

i V 
N-l 

E 12+ = £(iV-n)£ + h + i)\Y, m'Mn ~h + i% 

n—1 i i' 

N-l 

E X2 - = Y,(N-n)J2\i>(i)ip(-n + h + i)\Y,\^(i')i>(-n-h + i') 



= 0(N), 



n=l 



A change of variables shows that E\ 2 - = Ei 2+ , so it remains to verify that E\ 2+ 
0(N id ). Since, by (2.4), \tp(j)\/j d ~ 1 is bounded, we have, for any n > 0, 



i^in + if-'&i ) = 0(n M ~ 1 ) 



\d-l 



2t^-l^ 
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It follows that 

{N-l h-l 
n=h+l n=l 

The second term in the braces is 0(h 2d ) =0(1). The first term is 

N+h-l N+h-1 

U + 2h) 2d - 1 f d - 1 < J2 j 4d - 2 = 0{N id - 1 ). 
j'=i i=i 

This completes the verification that E12+ = 0(N Ad ). We have thus established that 
ESi(N,T) =cr 2 E[Z- Z(T)] 2 0{N Ad ). Exactly the same argument applies to S 2 (N,T), 
so (5.14) and, consequently, (5.13) follow. □ 
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